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ABSTRACT 

The Trouble-Shooting Checklist (TSC) is an 
empirically-developed, descriptive instrument which is based on the 
responses of six educational change agents. It enables an agent to 
predict a given institution's success in adopting innovations by 
ordering its levels of concerns and innovation usage. It focuses on 
tvo types of innovation: module-adoption and psychological assessnent 
battery combined with a personal counseling ori«intation. The TSC 
presents a set of eight information areas within these two courses of 
events and identifies for each the ideal situation for successful 
adoption and installation of BSD products, the marginally acceptable 
and the unacceptable situation. (Author/SB) 
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The Research and Development Center ^or 
Teacher Education was estabJished on the 
campus of the University of Texas at Aus^ 
in 1965, to design, buiid and t«$t effective 
products to prepare teachers for careers in 
the nation's schools, 

A staff of more than 100 are engaged in 
projects ranging from basic research into 
effective teaching behavior, through xJevelop-- 
ment of special counselor training strategies, 
to the development, implementation and eval- 
iialion of a complete and radicaliy different 
undergraduate teaciier education program. 

The Center's major program, the Person- 
alvzed Teacher Education Program, has its 
roots in teacher personality research dating 
back to the mid-Fifties. This earty research, 
which derrtonslrated how teacher's personai- 
itles and classroom behavior correlate with 
success -in their teaching :care6rs, has led 



to the tJevelopmenl of a large group , of 
products whtch help education laclBlTes be* , 
come aware of student teachers' Indi vidua! 
needs. The program also has produced prod* 
ucts for student teachers' use, to he3p them 
build on fh^r strengths, > ^ 

The completely mbduiartzed program Is 
currently in 'fi^d test aud/or use at more 
than a dozen Jmportant teacher education in- 
sUtiitions ^aHonaHy. 

in addition to the PTEP, the Center also 
supports other projects in oducatlonal eval- 
uation, development of strategies for imple» 
irtentlug-instttutional change, and in consul- 
tation techniqu€|5 for helping tepchers plan 
.individualized programs for chl oren. 

The Center's work is supported by the 
National Institute for Education and by the 
University of Texas System, as well as 
through contract research and development 
programs for public agencies. 



The "Trouble Shooting" Checklist; A 
Guide for the Educational Change Agent 



Brad A, Manning 



A ?aper Presented to the AERA Meeting 
Chicago, Illinois, April 15-19, 1$!^ 



Typically, it has "been difficult to achieve the adoption oi' innovations 
in educational institutions. Part of the problem has been caused by the 
educational change agent's inability to assess an organizational situation ijuickly 
and accurately and make informed decisions with respect to commitment of time 
and resources. Simply stated, he has had his time wasted, through no fault of 
his own, because predictors of potentially successful adoptors of innovations 
have been relatively unknown. The "Trouble Shooting" Checklist (TSC) is 
addressed to this problem. 

The "Trouble Shooting" Checklist (TSC) was developed on a pi-oject which was 
responsible for describing case studies of the adoption of the Personalized 
Teacher Education program (PTE) developed at The Research and Development Center 
for Teacher Education, The University of Texas at Austin. The TSC was originally 
designed to identify the variables involved in the adoption of two PTE components: 
modules and personal assessment feedback. 

Ihe design of the TSC may be classified as an innovation sr.ecific approach 
to the study of the adoption-diffusion process, and seme explanation of the 
specific innovations upon which the TSC focuses, is needv^d. A module is a set 
of learning experiences which allows a student to move at his own pace towards 
specific objectives. These objectives, stated in behavioral tenns, aro accom- 
panied by Justifications and procedural instructions. There are usually built-in 
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activities I such as small group seminai^s or various field experiences, whic^h 
are designed to help the student reach his obj^^ctives. 

Personal Asseasinent yeedback ( PAF) Is a system designed to measure and 
infom teachers of tlieir personal and interpersonal skills* A variety of 
techniques, such as counseling, fi^ja and self •report ittstruments, are usea to 
help teachers hecome more aware of their appearance, the effectiveness of therr 
teaching styles^ ar:d their interaction skills. As a feedback approach, the 
PAF allows the teacher to have a greater responsihility and personal involve:ntnt 
in effecting change* 

Although the original intention was to provide an empirically hased listing: 
of variahleB which might aid in the description of narrative case history 
accounts of the adoption process, the TSC gradually developed into an instrunient 
designed to aid the educational change agent in the process of introducing inno- 
vations to institutior ^ of higher learning. The TSG provides the educational 
change agent with information about environment€Ll events, personalities, and 
organizational structureii upon which he must base his decisions and consequenx 
commitment of time and resources* The main objective of the TSC is to assist 
an educational change agent in predicting his chances of successfully helping 
an institution adopt an innovation by giving order and predictive meaning to 
information gathered from otherwise unknown institutional settings* The TSC 
consists of two distinct psychometric instruments, the TSC-A and the TSC-B* 
The TSC-A is a predictive instrument to be used in Institutions which have 
adopted or are considering adopting a module. The TSC-B is a predictive instru- 
ment to be used in institutions which have adopted or are considering adopt in,.; 
a psychological assessment battery with some form of personal counseling orient a- 



tion. For each of these two institutional settings » tht> TGC iaentific-s the 
ideal situt^tion for successful adoption and installation of P^D product?^^ ihv^ 
marginally acQestable situation vhich contains greater rif>k of i^uccess^ ani the 
clearly unacceptable situation in vhich virtually no chance of auccensful auf)] 
tion and installation exists » 

It should he emphasised that , although these instrument s t*ire psycKt:?r*ctrit^tl 
formatted and liave empirically based items, norms for their application h^^ve i.ot 
yet been generated » Although these instruments oannot be adequately used uni^il 
such norms are developed, a logically based scoring system is offered* Plan^ 
are nov under way for initial norming and validat:lon, and it 3 a hoped that grc^;p 
of institutions vill generate their own norms as veil. 

The instruments are contained in a manual entitled '^The •Trouble Shootinr^ 
Checklist: A Manual to Aid Educational Change Agents in the Prediction of 
Organizational Change Potential*"* The manual includes a selective review of 
the literature, a description of the development o:' the instrument , the tvo 
"Trouble Shooting'* Checklists, guidelines for the change a^ent, ai'ad predict! ora^t 
of event secLUences for each of the ideal, marginal , and unacceptable institute 

After reviewing a selective sampling of the adoption-diffusion literature 
related to the prediction of institutional change, it seemed possible th^^t the 
data on institutional variables which had been collected could serve as a lacis 
for the development of a much needed instrument which would be predictive of -ir. 

*Thi3 manual is available from: The Research and Development Center for Teacht-^r 
Education > The University of Texas, Austin, Texas 70112. There is a charge of 
$6,U8 since the Research and Development Center does not have funding fcr aisrc?^^ 
tion. 



institution's potential tor siic:cessfully adopting an innovation. Hilfiiv^^r 
(19T0) s^OTinarizos this need: 

Little attention has Tse^n given to the social or psyohologicril 
charaet eristics of the receiving system (such an a ^school or 
school system) and how these characteristics might affect 
the fate of a given innovation or change, .^If it hr^ccnes possible* 
to consiotently diagnose and evaluate the "state^^ of ^ t::hcol 
system^ s organizational climate ^ it might he feaslhlt^ to mouify 
the adapt ability of professional personnel and to cl..inge or creates 
organizational structures zjid processes which tend to enhance the 
possibilities of successful institutionalization of Innovations • 
An instrument designed to providevdata appropriecte to sucr* chmiue 
processes, with the ultimate objective of modifying the system, 
might also aid in identifying conditions contributing to excessive 
change or unstable conditions. An analysis of such conditions 
might indicate that the system should achieve or return to a 
state of equilibrium rather than undertake extensive change efforts 
(p- 27). 

Rogers and Shoemaker {1971) also point out the value of b^^ing able to estimate 
change potentials vithin an organization before deciding on a change strategy* 
"There is much practical usefulness for change agents if they can identify 
potential innovators and laggards In their client audience and utilize differ- 
ent change strategies (p. 175)." Before detailing the development of the TSC-A 
and the TSG-B> a selective literature review relating to the prediction of in- 
stitutional change will be presented* It is offered as a context from which 
to view The ^'Trouble Shooting" Checklist * 



Selective Review of the Literature 
The first section of the selective review is an introduction and general 
background. The second section discusses the effects of instit-.tional variables 
on rates of adoption • The third section describes the use of diagnostic 
instnanents in the stud;^ of institutions. The fourth section siv^s a brief 
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suitimary of Bhola^s config'umtional theory* Per readers who wirh to oV^ nir. 
ti*^ TSC manual (mej:itioned Jibove) Xhc folloving additionul topica aro 
revievedt st&«os of the mioptlcn-dif fusion process > the role of coirjrr^unic^iiiou 
in the adoption-diffusion procesn, the role the change a^ront in the adw.ti?^^- 
diffusion process^ arid the problem of choosing change strategies for uiffi^vii^i: 
types of institutions* 

Introduction and General Background Information 

Various approaches to the study of innovation have been established* 

Wi.;».lower {19T0) names three such approaches. The first stressec the conl>r^nt 

of the curriculum and the preparation of material to correspcna vl th the pro.cr^^R; 

cbjc>ctives of particular fields of study, A second approach ^ rf;*forrt?d to as u 

"process" approach^ considers innovations in terms of the interests and neodp, 

of the students ^ presupposing that learning is increased vhen studeritii hwe 

positive attitudes and high motivational levels • A third apjiroach the 

literature on innovation in education is that of "adoption-diffusion." Willov^r 

describes this approach as having 

emphasis^.^on.. .adoption and diffusion^ including such factors 
as the characteristics of oarly and late i^dopting units, the rate 
of diffusion and distinguishing features of innovations that accorr.- 
pany variations in this rate.,, [the adoption-dlffusi ^n ?4rpro^ch] • . . 
has its historical roots in rural sociology and the study of new 
farming practices (p. 388-3Q9)v 

Eichhol^ and Kogers (l961*) > using the "adoption^dif fusion'^ approach tc 

innovation, describe diffusion as the complete process by which ^in innovrAtic.:; 

is communicated, diss'-^minated, and finally adopt**d throughout a user syster.v 



ERLC 



9 



ITiie adoption aiid diffusion of innovations has typically beer, a difficult 

and complex pvoc'ir^s. The length of time involved from the initial awaret^L-sa cf 

a need to the final diffucion of an innovation throughout a 'user systejn varitss 

from institution to institution. Certain agricultural innovators reported -%n 

average time lag of 1.5^ years between the time of awareness and adoption (Btitil, 

Rogers, St Bohlen, 195T). Studies of other technological innovations suggest 

^at five to ten years is a typical time lag (Voegel, 19T1). As Mort (l9cH) 

states in reference to educational innovations: 

The early studies indicated that change,,, comes about through a 
surprisingly slow process and follows a predictable pattern. Be- 
tween insight into a need... and the introduction of a way of neetin? 
the need,,, there is typically a lapse of a half-century. Another 
half-century is required for the diffusion of the adat>tation. During 
that half-century of diffusion, the practice is not recognised UKtiS 
it has appeared in 3% of the systems of the country. By that tisie, 
fifteen years of diffusion— or independent innovation— have elapsed. 
Thereafter, there is a rapid twenty years of diffusion, acGompiiniffd 
by much fanfare, and then a long period of slow diffusion through the 
last small percentage of school systems (p, 318), 

This tremendous time lag, together with reports from the U, S. Department 

of Commerce that up to 90^ of all innovations fail within four years after 

being introduced (Rogers & Shoemaker, 19Tl), indicates the size of the problem: 

faced in implementing innovations in our educational system. In order for our 

educational system to keep pace with our rapidly changing society, more expedient 

methods of integrating innovations into organizations are being developed. One 

such method involves the use of a versatilely trained social science prof^?s3ior.*sl 

in the role of a change agent. Such research-based agents are proving tc t*.' .\ 

crucial link between information centers and the classroom (Cooke & Ealtmari, 

Kerins et al., 1971; Rlchburg, 1970; Voegel, 1971). The change agent fills ti l;? 
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role "as a learniKg system expert in cooperating with tise faculty -i'^-^r^j., 
implement and evaluate new instructtonal strategies and at^prcaches (Vc^r^l^ 
p» 69)*^^ The change agent must be able to translate a concepttial r;o\i<:*l ^nto rx 
learning or instructional models vhich he then introduces and ht^lpr* tc ir.tei^*rni>- 
into an organization. This requires not only an understandinir of the inj;oYHt: 
but also knowledge of the facilities^ location, aid, informaticn resourt^t^:: , ,.:'r, 
and materials of the institution (Voegel, 1971) • The strat^^t^gy for introducini?: 
and presenting the innovation would depend on these variables » The change airer.t 
also irsuct he able to use behavioral science teehnigues at specific interventic:- 
points {Beckhard, 19^j9) which vary fron; institution to institution ai.d with p^^rtl- 
cular innovations (Bogers & Shoemaker , 1971; Stuart-Kotze, 197?). 'f^ie Job of th>> 
change agent then, is nothing less than "that of harnessing the bureaucracy, of 
creating structures designed to nurture a genuine concord of values, goals, iind 
action (Willower, 1970 > p, 390)/" In other words, he guides the adopts on-diff^^- 
si on process* 

The tvo main approaches to the study of the effects of variables in the 
adoption-diffusion process appear to focus on: characteristics of innovations, 
and characteristics of the adopting organization* Rogers and r^hoe^T.aker (1971) 
examine both approaches. In their discussion of characteristics of innovntl'vna, 
the emphasis is on how the perception of the innovation by the adopting insti- 
tution affects its rate of adoption. Characteristics of the innovation whicl. :.t\v 
discuss are; itti relative advantage to the institution; its coripatil:^llity • 
its lack of complexity J the ease with which it can be denionstrated; and, It^j 
observability* 

11 
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Investigators (Bhola, 1972 j Borers & Shoemaker, 1971) hnv- ulr^o foeun.-.: 
on institutional variables and how they affect the adoption pi^ctisr.. Thir. rt-v^ 
of the literature and subse<i\ient development of the T5C 3s conc'rned vlth tLl: 
latter approach. 

The Effects of Institutional Variables 
on Rates of Adoption 

I^ates of adoption have "been used by investigators as the hasiB i*or 

categorizing institutions. Studies indicate that adoption rates can be 

graphically illustrated hy an T-shaped curve (Alha, v969; Beal et al., 1?5T; 

Carlson, 196k ^ Mort, 1961*; Rogers & Shoemaker, 1971). 

The S-shaped adopter distribution rises slovly at first when 
there are few adopters in a tine period. Then it accelerates 
to a mtDcimum when half of the individuals in the system have 
adopted. It then increases at a gradually slower rate as the 
few remaining individuals finally adopt (Rogers & Shoemaker, 19T1, 
p. 176). 

The S-shaped curve is explained in part by learning curves (Beal et al, 

lOT; Rogers & Shoemaker, 1971) and in part by the "diffusion effect" (Rogers 

& Shoemaker, 1971). The diffusion effect is defined as 

,,,the cumulatively increasing degree of influence upon an individ- 
ual to adopt or reject an innovation, resulting from the Increas- 
ing rate of knowledge and adoption or rejection of the innovation 
in the social system (p. l6l). 

On the basis of the S-shaped and the related bell-shaped curves of 4'i'-.T.t;"o 

diffusion, Rogers and Shoemaker (1971) classify and describe institutionG by 

the following categories: innovative, early adopters, early majority, late 
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majority and laggards. In another studyi Smith (19T0) developed a ^rid id^njti- 
fying four type^s of institutions Oh the basis of tvo institmionai varifibl>N^» 
One variable i^ the degree of cha&Ko ^sought and the othf^r ;s tho lovol 
involver*ent of members of the organisation* Vhen both the level of chnugo r>'*u?}.* 
and degree of involvement are high| then the institution is deGoribca as :v;r\^i 
for innovation, Wlien they are both Icw^ the institution is likely to be ur^r.uc- 
cessful in adopting an innovation* When the institution has high involvement 
and low change or high change and low involvement, then chances are moderator 
vhat the innovation vill be successful. 

Although the literature contains descriptive models of institutions bast^vi 
on rates of adoption, systematic categorisations of organis^ational variables 
vhich would affect the adoption-diffusion x^^^cess have not been found, ivecanrr^r 
of the need to consolidate a va^t array of organizational variables from many 
studies^ the following categories will be used: l) organizational structure; 
2) personality and leadership styles of orfc:anization members; 3) eominunlcation.3 j 
U) level of usage; and, 5) characteristics of sLudents within the insiitutlon. 
These categories will be examined within the contexts of ideal , marginal ana 
unacceptable institutional settings* Since the literature has Indicated tl^at 
there are many similarities between agricultural variables and eduoational vnri- 
albes which affect the adoption-diffusion process, some of the findin,vs inoluao.: 
in this section are derived from agricultural settings. 
Ideal Institutions for Successful Adoption of Innovations 

Organizational structure > One measure of an institution sugges^.^^d by 
McGrath (in Bolman, 1970) is the degree of "democratic governance." ":)omccr^* : ? 
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governance has to do with the extent to which indlvidvials in the campus 
conanunity vto are directly affected hy a decision have the opportionity to 
participate in making the decision {p. 595).'* 

Hilf iker (19T0) , in a study conducted to determine vhat independent 
variables were related to successfal innovation in school systems, collected 
empirical support to illustrate the importance of democratic governance. 
The following variables were found to be statistically significant at the 
• 05 probability level: social support provided by administrative personnel as 
perceived by professional personnel; satisfaction with the quality of pTdbl&& 
solving and the amount of time spent on it during staff meetings ; the degree 
of powerlessness felt during faculty emd administrative coimcil meetings; and 
the degree of openness and trust felt within the organization. "Openness" ir, 
a key word repeatedly used to describe the ideal institutional climate (Hearn, 
1970; Hilfiker, 1970; Smith, 1970). However, Maguire (1970) points out that 
conflicts might be expected when structured change is introduced in such an 
"open," democratic institution. 

Institutional mechanisms must be present which encourage and facilitate 
change: l) time and resources must be made available; 2) freedom to try inno- 
vations without fear of penalty for failure must be guaranteed by the organise 
tion; 3) there should be rewards for the successful adoption of innovations; 
and, h) control of substantial financial resources may be necessary to absorb 
the costs of possible failures (Smith, 1970). It has been foune that the r.ost 
successful innovation adopting institutions have hi^er expenditures per pur : : 
more local eommitjient of funds, and higher family incomes (Bigelow, I9U7; Hei-.ir 
1970; Ross, 1958). 

14 
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In general, the successfully adopting institution is lai'f.ir in size 
(JHearn, 1970; Rogers, I962) and has mre active participation from all Taemb^-Tv 
of the organization (Hearn, 19T0), 

Personality and leadershit) styles of organization mem'beys . Th« llteraturt? 
indicates that administrative support is needed to create an institutional 
climate receptive to and actively encouraging Innovation (Brightman, 1971; 
Grandall, 1972; Feitler & Blumterg, 1972; Smith, 1970). In general, innovative 
administrators e^e described as more cosmopolitan than non-innovators (Bogerc 
& Shoemaker, 1971; Byan and Gross, 19^3; Volf & ?iorino, 1972)* They are likely 
to have "been born in nu^al en\'ironments, to have moved wore often and have 
attended more out-of-state meetings than non-innovators (Hearn, 1970). It 
has been datermined that those administrators who are better educated (Carlson, 
19Di»; Hearn, 1970), have had more experience as administrators (Hearn^ 1970), 
and have the highest level of interaction and involvement (Carlson, 196i+) are 
the mo^u innovative. Innovative institutions also have more opinion leadership 
than non-innovative institutions (Rogers & Shoemaker, 1971); and, while age 
isn*t necessarily an important variable, younger administrators are often more 
innovative (Hearn, 1970). 

Innovators have a willingness (Feitler & Blumberg, 1972) and even an eager- 
ness to try new ideas (Rogers & Shoemaker, 1971 )♦ They often exist as a clique 
of friends who communicate closely even when geographically distant (Rogers & 
Shoemaker, 1971). 

Communi cations . Infomatlon on the neture of communications between change- 
agents and client institutions Is limited, but there are indications that commu- 
nications occur more frequently with earlier adopters than later adopters (Rog-^rs 
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& Shoemaker^ 19Tl)» Institutions vhlch have better internal coinmuni cation 
systeas also have a greater diffusion effect and therefore h, faster diffusion 
rate (Rogers & Shoemaker^ 1971)* 

Levels of us age ^ The greater the number of Innovations tried in the past^ 
the greater the chances of adoption of the new product (Heam, 19TQ) * Based 
on the S*-shaped curve of rates of diffusion, ideal institutions adopt ijitf ovations 
at a very high level early in the adoption-diffusion process ♦ 

Characteristics of students ^ Students of innovative institutions are 
primarily from higher income families (Bigelov, 19hli Hearn, 1970; Boss, 195B). 
They btb able to make contributions to the organizational whole and their 
ideas and suggestions are heard (Hearn, 1970)* They perceive their institutiGn 
as an ^'ideal^' learning situation (Crandall, 1972)* 

Marginally AcceT)table Institution for Successful Adot)tion of Innovations 

Since the largest number of institutions will fall under this category 
and because many of these institutions will have varying rates of adoption- 
diffusion, it is not likely that any one institution will have all of the 
following characteristics in the same degree* The more the statements charac- 
terize the institutional variables of a given setting, the greater the chances 
for a speedier adoption; and, conversely, the less the statements characterize 
institutional variables, the less likely will be the chances for a successful 
and speedy adoption. 

Organizaticaial structure * There Is, unfortunately, much more information 
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on personal characteristics of adopters than on organizaticnal variatlc?;^ 
(Hilfiker,^ 1970; Ilogers & Shoemaker^ 1971; Wllloweri 197C)^ The marginally 
acceptal)le institution is descril)ed as having a ^Vell-intepratea^^ system. 
The more innovative the institution^ the more modern vill ho Its institutional 
norms; the less innovative^ the more traditional the norms. Later adopter 5 ir, 
this category are likely to adopt only because of economic necessity or in- 
creasing social pressure (Rogers & ShoemcQcer , 1971)* 

Personality and leadership styles of organization members . The more 
innovative the institution, the more opinion leaders there vill he* The 
leaders vill he better educated, have higher social status, greater upvard 
social mobility, vill be members of larger orgcmizations, and vill be more 
favorable tovards change, education and science* They vill be less fatalistit^, 
have higher levels of achievement motivation, higher aspirations, will be more 
cosmopolitan, and vill have greater exposure to mass media and interpersonal 
communication channels (Rogers & Shoemaker, 1971) # 

Communi cati ons # The more innovative the institution, the more contacts 
there vill be betveen the institution and the change agent (Rogers & Shoemaker, 
1971). 

Level of usage . Based on the S-shaped curve of rates of diffusion, some 
of the marginal institutions vill adopt fairly early (13#5^)> i^ost vill adopt 
after the initial adoption by other (3^^),^ and a large number vill adopt ^ift*^r 
the majority (3^%) (Rogers & Shoemaker, 1971)* T^e level of usage of ir.n^v^a- 
tions thus increases by large percentages among the institutions vitiiin tr,ic 
category • 

o 17 
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Characteristics of studeats. No information relating directly to 
student populations of these institutions vas found. Hovever, after examining 
descriptions of more innovative institutions and less Innovative institutions, 
it can "be reascaiably expected that the students would come from the range of 
middle to lower-upper income families, €Uid may or may not have some voice in 
de cisi on-making ♦ 

Unaccentable Institutions for Successful Ado-ption of Innovations 

Organizational Structure . Derr (1970) outlines in detail an organizational 
situation in which innovation efforts failed. Departmental organization is 
described as "uncoordinated" with very little sharing of information. The 
change group had to agree to confidentiality from the ■beginning, vhi ah greatly 
hindered the team's ability to share information. Shared decision-making was 
non-existent and there were many dysfunctional power struggles within the 
organization. Directives from high administrators were consistently ignored. 
Pronounced status and pay differentiation existed between department heads. 
Power within the organization was dependent on patronage, informal contacts, and 
social contacts. In some Instances kinship ties were a factor. Partly as a 
resiilt of such administrative practices and policies, there was a pervasive 
sense of alienation and defeat. Members of the organization hardly knew one 
another and many met for the first time during the project workshops. This 
situation is exemplary of Magulre*s (19T0) comments on administrative patterns 
which remain constant while educational processes we changing. 
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Personality and leadership styles of organization membern , A'-son;? th^^ 
laggards there are virtually no opinion leaders (Rogers 8e Shoemaker, 19T1). 
Administrators are suspicious of collahoration (Derr, 1970) «nd of innovations. , 
innovators and change agents as well (Bogers & Shoemaker, 19T1). In genf^fal, 
they are described as localized in their outlooks, nearly isolated, ^uid f-.-cusisi 
on the past (Rogers & Shoemaker, 1971). Eichholz and Rogers tl9£k) deccribi:; 
them as heing ignorant of innovations or having no Interest in cliange. Tn^y 
are supporters of the status quo and societal mores. Often, they had pre- 
viously participated in an unsuccessful innovation. They are describeti as 
very dependent on peer opinions and tending to adopt only when pee-r pressure 
favors adoption and the status quo permits it. 

Communications . In the study which Derr (19T0) cites, there was & two moritn 
period of deliberation before the first exploratory meetings took place, Cor^wa- 
nication and collaboration between the change group and the administrators rc~ 
mained very poor throughout. Attempts at collaboration were often turned dowr. 
because the administration considered it too time consuming and unnecessary. 
Requests for distribution of information and reports were neglected. Adisinistra- 
tors miscommunicated information from the change group to the staff* In general, 
information exchanged between the two groups was of poor quality. The rc-al r.'^«-ds 
and intentions of the two groups (the institution and the change group) were nox 
well communicated or accepted by the other. "Lack of open disclosure about th'j 
needs of the two groups resulted in a client-consultant power c*ruggle vh-ir'.- 
side spent a good deal o^* time trying to second guess the motlvon ixxA tiext r,ov 
of the other side (p. 1*12)," The institution was not really interested in inno- 
vation, but rsither, wanted the report from the change group in order to bargain 
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for more funding and staffing. Perhaps this hazard Is not uncoiamon to chance 
agents:. In a study by Yates (1971) it was determined that tnere vere no Bigui f- 
icant differences in the perception of nev state plans for special education 
between those who had adopted the innovation and those who had not. The only 
apparent differences between the two were ;).ncreased funding and staffing for 
the "innovative" school systems. Beyond the increased funding and staffing, 
there was no interest in innovation. In an unacceptable institution, the real 
needs and intentions of an institution are often not communicated to the change 
agent. 

Level of usage. If there has been previous usage of Innovations, they 
have most likely been unsuccessful attempts CEichholz & Rogers ^ I96U), If 
these institutions adopt at all, it will be veiy late compared to other insti- 
tutions. Even more likely, however, is that this group will not adopt at all 
or will adopt only some aspects of a program under peer pressure. 

Characteristics of students . Since there is no free communication within 
the organization or shared decision-making (Derr, 1970), it can be reasonably 
expected that the students* ideas will not be considered. There will be a sense 
of powerlessness among most members of the organization (Derr, 1970), 

Diagnostic Techniques 

Survey feedback and interview techniques seem to be the only explicit 
techniques used by change agents to obtain Information on organizational variables 
There are many accounts of the use of such techniques in business and industrial 
settings (Bennls, I966; Lorsch & Lawrence, 1969; Miles, Homstein, Callahan, 
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Gaiaer^ & Schlavo^ 1969)* 

Survey feedback is a process in which outside staff imd 
members of the organiaation collahoratively gath^r^ analyze 
and interpret data that deal vith various aspeGts of the 
organisation Vs functioning and its members • work lives ^ and 
using the data as a base l>egin to correctively altor the 
organiaationid strttcture and the members^ work relationships 
(Miles et al., 1969^ p* 

Data collected is then "fed back" to the suhjects from whom it is collected* 
In such a way , the clients themselves become involved in the analysis procesj- i. 
This "feedback" usually takes place in one of two ways: through top management 
who make the diagnosis; €uid, through the change agent who presents a diagnoses 
(Lorsch & Lawrence t 1969). As Lorsch and Lawrence explain, there are difficult 
ties vith this method, in that high level management personnel are often unahle 
to see the full scope of problems from their vantcige point, and change agents 
are not always able to effectively communicate their diagnoses to the management * 
A third problem which Lorsch and Lawrence mention is that the action is often 
planned in advance of the actual diagnosis, in which case, the diagnosis be- 
comes a useless exercise or even a stalling technique* Perhaps one of the problemr> 
is that of the manner in which the diagnostic instruments are used, JJavelock 
(19TI) notes the problems that may result from either omlBsion of, or "obsession" 
with the diagnostic stage. When adequate diagnosis Is omitted, solutions may be 
invalid or harmful (Watson, I966); over-emphasis on diagnosis may reduce the 
chances that a solution will be sought (Havelock, 1971) • However, all the authors 
point out that such survey techniques can be effective, Lorsch and Lawrence (I969) 
state that change strategies aimed at problem areas can be effectively developed 
on the basis of such feedback. In addition, personnel can be directly involved 
in the change process by offering opinions and suggestions on the survey as vr:ll 
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as in later ^'feedback anal^'sis" groups. 

Similar diagnostic sui"vey approaclies, designed to be used in educational 
settings, are described by Havelock (1970). Haveloclc states that the dlaj^nostvc 
approach results in . ♦ a description of the client *s problem which Include 3 
the essential details of symptoms, history, and possible causes (p. 59).** 
Included In this document itre a series of questions aimed at uncovering problem 
areas vithin the educational institution. Many of the potential problem areas 
which he Includes are similar to those included in the TSC. However, there 
are distinct differences between Havelock'' s diagnostic approach and the TSC. 

First of all, the TSC Is innovation-specific. Organizational strengths 
and weaknesses are considered from the perspective of how they would affect the 
adoption of a particular innovation in a particular institution. Generally, 
an Instrument designed for diagnostic purposes is used to identify the problem 
areas in an organization in order to determine what changes should be made. The 
TSC might be useful for this ptirpose in that it does Identify organizational 
variables within an educational setting, but clearly that is not its sole pur- 
pose or aim. 

Secondly, the TSC is predictive in nature. The results of the checklist 
are inter.ded to aid a change agent in deciding whether or not bxi institution is 
suited for a particular innovation. The TSC is not specifically designed for 
diagnostic purposes, since it might be possible for an Institution to successfully 
adopt and diffuse a particular Innovation without changing "trouble spots" vithin 
the organization. The "trouble spots" are Indicated as a caution to change a/ fintc 
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in working with an institution. 

Finally, while survey instrtMents are designed to he distribu%«d to a 
numher of personnel within the organiaation, the TSC is to he completed hy 
the change agent himself, although it might he helpful for the chouf^e agent 
to use survey techniques in collecting data for the TSC, 

Bhola's Gonfigurational Theory of 
Innovation Diffusion 

Another in^jortant approach to the study of institutional variables and 
how they affect the success of an innovation is Bhola's (1972) " configurations.! 
theory." As he describes his theory, it 

is designed basically to explain the process of innovation 
diffusion and predict in probable terms success or failure 
of innovation diffusion plans and projects. It focuses on 
the diffusion event and its practical concerns lie in increasing 
the probability of occurrence of such events (l, p. 12-13). 

According to Bhola, successful diffusion :5f an innovation depends on four 
variables: configurational relationships (social units) , linkages (communi- 
cation patterns), the environment and available resources. Each of these 
variables, in relation to each other and to the innovation, affects the success 
of the adoption process, Bhola suggests a system of charting these variables 
in relation to each other so that it is possible for a change agent or change 
target to predict potential success and plot strategies for change. The theory 
is very well-developed and inclusive and, as Havelock (1971) points cut, "is a 
most significant step toward a general science and an engineering science of 
D & U (Dlsst minatlon and Utilization) Process (p, 11-10)." 
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Configurations, or social units, are oonsldereti in terms of the indivia- 
uals, groups, the institution, and the general culture. The adopter system 
is the ^'Target Configuration," "Configuration plotting" or ^'napping" is 
described as 

the process of identifyiJig the configurations . . .withift or 
without the boundaries of the configurations directly involved 
as innovator (s) in a change episode j and of presenting, graphically, 
their relationships in terms of structural bonds, loceitions in 
systemic space, hierarchy, and mutual expectations of influence 
and compliance established by custom, tradition or lav (II, p, k) , 

Such mapping depends on both empirical knowledge and speculation. "Linkages" 

represent communication patterns between two configurations, which may be llnke»1 

directly or indirectly (through a third party). "Linkage typing" is described 

as a system of graphically illustrating various types of linkages, Syrobolically, 

Bhola represents his theory in the following equation: 

D=f(C,L,E,R) 

Or, spelled out, 

Diffusion (D) is a function of the configurational relationship 
(g) between the Initiator (i) from a class of such initiators and 
the target (j) from a class of such targets; the extent and nature 
of the linkage (L) between and within configurations; the environ- 
ment (23) in which the configurations are located; and the resources 
(r) of both the Initiator and target configurations (II, p. 8-p), 

The TSC, in essence, is designed to be a quick screening devicej whereas, 

Bhola* s configurational theory of innovation diffusion makes it possible to 

study all aspects of an organization in depth and in relation to each other. 

However, since the TSC identifies and describes many of the s&jne organii:;Ation'a 

characteristics as Bhola's configurational theory, the configurational theor/ 



maj' offer a validity cbetk for indet.endently.develoDed instm-seRts such as 
the TSC. If a theory as sophlBticated and comprehensive as Bhola's produces 
predictions similar to those of the TSC, this would lend great support to 
the TSC. 

Theoretical Framework of the "Trouhle Shooting" Checklist 

The TSC is related to the Concerns Based Adoption Model (Hall, Wallace 
& Dossett, 1973) presently under investigation at the Research and Development 
Center for Teacher Educfttion. This model describes the effects of stages of 
human concern in interaction with levels of use of an innovation within an 
educational institution. The CBAM (Concerns Based Adoption Moael) draws upon 
Puller's {1969) paper on concerns of teachers and descrihes many of the attitudes 
and dynamics of innovation-adopting members of an institution. Typically, 
teachers facing a new situation (or new innovation) will first De worried about 
their abilities to cope with the situation ( self concerns) . After such concerns 
are resolved they will focus on how to use the innovation in the classroom 
(task concerns). Finally, they will ask themselves how the innovation can be 
used to help their students and fellow faculty members ( impact concerns) , The 
CBAM also assumes that an institution will use an innovation differently the 
second and third time it is tried. Under normal conditions, with reasonable 
access to resources, an institution's members will gradually change their concerns 
from self concerns to impact concerns and consequently increase th-'slr l«ivel of 
usage. The level of usage of an innovation will typically br^gin with an crier. tu- 



tion stage in which members of an institution go throiJgh sn initial adjustment^ 
Intermediate stages are centered around training and practice. Final stages 
focus on the integration of the innovsition into an entire institutional progra.t 
At this point, a renewal stage is possihle insofar as institution members are 
able to build effectively upon a successfully adopted innovation. 

The TSC is based on the assumption that, in order for these stages of 
concern and levels of use of an innovation to develop to a nophlcticated degree 
certain conditions must be met. The TSC attempts to identify these conditions 
within five basic dimensions, each of which has several sub-di visions, Ihe 
first dimension is Organization Structure and is divided into the following 
subdivisions? organization structure; social-professional cliriate of the 
organization i characteristics of the faculty; and, characteristics of the admin 
tration (for the TSG-B, characteristics of the counselor are also included). 
The second dimension is Personality and Leadership Styles and is divided into 
the following subdivisions: personality and leadership styles cf the faculty; 
personality and leadership style of the department chairman; and, personality 
and leadership style of the dean (for the TSC-B, personality and leadership 
styles of the counselor are also included). The third dimension is Nature and 
Type of Cororouni cations Used and is divided into the following subdivisions: 
general nature of all communications used; frequency and nature of letters hr."- 
phone calls; and, freqLuency and nature of personal visits. The- fourth dimenrJcr 
is Level of Usage of Modules and Other Instruments and is divided into the 
fcllowing subdivisions: first stages of adoption; prediction of later stages of 
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adoption; and, organization aenbers' attitudes toward the innovation. The 
fifth dimension is Description of Prospective Teachers and is divided intc tht- 
folloving subdivisions! personality and social characteristics of prospect iw- 
teachers; academic style of prospective teachers; and, characteristics of fticul 
vhich affect prospective teachers. The atove five dimensions with their 
corresponding subdivisions arc also the names of the ma^cr scales and correspcn 
ing subsca3.es in the TSC^A and the TSG-B, 

Methods and Techniques 
The TSC vas first developed as a survey form (TSQ - "Trouble Shooting" 
Questionnaire), which was used to collect the information upon which the presen 
TSC is based. The TSQ was a twenty-nine page questionnaire which presented 
eight question areas in six different institutional contexts. The eight quest i 
were open-ended, allowed for written response and had the following focal point; 
1) organizational structure; 2) personality and leadership styles in adopting 
institutions; 3) sequence of events in the adoption process; k) personality and 
leadership style of change agent; 5) nature and type of communications used; 
6) sequencing of action interventions; 7) level of usage of modules and other 
instnunents ; and 8) description of prospective teachers. The six different in- 
stitutional contexts for these questions were: ideal situations, marginally 
acceptable situations and clearly unacceptable situations for the two separate 
cases of a) module-adopting institutions, and b) institutions adopting a 
psychological assessment battery with a counseling orientation. 



Tot exaaple, the questiofts iti area 1 (Organisational Structure) for 
an ideal module-adopting institution were: 

!• What organizational structure should exist? 
a, Brav m organizational hierarchy^ 

Identify key positions* 
c» Define exactly vhat characteristics would found in 

a ^Vi'of^ssionally ^nature" organization. 

A change agent at !Ehe University of Texas Research and Development Center 
was asked to respond to the TSQ in as much detail as possil)le. His written 
responses were then shortened, checked for repetitiveness and synthesized. 
These responses were then typed into the questionnaire and uned to give sulDGe- 
quent change agents a set upon vhich to base their responses* Since the 
questionnaire required an average of five hours to ccattplete and the questions 
were open-ended, it was necessary to supply some structure in the form o: ^nothor 
change agent's responses. An additional advantage to including a change r>, y\^s 
responses on the questionnaire was that these responses in their rewritten and 
synthesized form encouraged subsequent change agents to make their own responses 
as succinct as possible* An example of one of the eight question areas with the 
rewritten response of The University of Texas change agent to the question con- 
cerning organizational structure > is as follows: 

(1) Only small group of adopters necessary. 

(2) Department chaiman strongly supportive /with public 
statements, promotion rewards, providing aresources. 

{3) Dean's support helpful but not necessary for an individ- 
ual modiile. 

Five other change agents were invited to The University of Texas P&D 
Center and responded to the TSQ* In addition to being given the w^^tlonnair^^ 
with L, change agent's responses, they also received two charcnj or.e for rio^'iu 



adopting institutions and one for institutions adopting a psychological aa^ess- 
inent "baittery with a eounselijflg orientation. Each of these chfj.rts plotted th<r 
focal points of the eight questions on the left hand margin against ideal^ 
inarg:>,nal, and clearly tmacceptahle situations in the columns. The chartc enabled 
the change agents to get a quick viev of the overall conceptualization of the 
questionnaire. The cheaige agents* responses were then rewritten and synthesized^ 
All change agents reported that the questions adequately prohed the organizational 
variables to which a change agent responds when he approaches an institution taid 
that the recorded responses on the questionnaire aided them in recalling infor- 
mation. The change agents did not feel that the recorded responses presented a 
limiting psychological set. The rewritten responses of all six change agents 
were then revised and fitted into the format of a checklist (TSC). 

The responses of all change agents were then synthesized to me^e them as 
succinct as possihle without losiiij: descriptive information. They were also 
sorted into natural groupings within each question area. In addition the eight 
question areas were restated as information areas. The initial draft of the 
TSC (Checklist) form thus consisted of listings of rewritten responses^ placed 
in natural groupings, under the appropriate infoimation areas and institutional 
contexts. 

It was then decided that three of these informfttion areas (sequence of 
events in the adoption procesB, sequencing of action interventions, and per sonal-^ 
ity and leadership style of change agent) would he more effectively used as 
guidelines and listed predictions of event sequences, than as a jjhrt cV tho 
checklist. These sections were later placed at the end of the final version 
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the TSC manual. 

The five remaining information areas, then, were: 1) organizational 
structure; 2) personality and leadership styles in adopting institutions! 
3) nature and type of communications used; k) level of usage of modules and 
other instruments; and, 5) description of prospective teachers. 

The naturally occurring groupings under each information area were then 
combined into the uniform su'bdivisions which are listed in the Theoretical 
Framework section of this paper. All items were then placed laider the appropri- 
ate uniform suhdivision. The result was that the miform subdivisions did not 
contain an equal numher of ideal, marginal and unacceptable items, Conseci.uently, 
items were generated on a logical basis until the number of items under each 
subdivision of the five information areas were equal for the ideal, marginal, 
and unacceptable institutional cases. If, for exeunple, under the information 
area of organization structure for module-adopting institutionc, and the subvii vi- 
sion social-professional climate of the organization, there were eight items under 
the ideal situation, eight items imder the unacceptable situation, and six under 
the marginally acceptable situation, it was necessary to generate two items for 
the marginally acceptable situation in order to equalize the number of items 
occurring within the subdivision of social-prof esfsional climate. These two items 
were written in such a way that they would represent approxinations of mid-points 
between the ideal and unacceptable items already recorded. 

Ai^er the item numbers were equalized for each subdivision within the 1-1^;^!, 
marginal and unacceptable situations, the items were assigned ncore values of 
2, 1, and 0, respectively. The ideal, marginal and unacceptall'r itens withij-. 
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each subdivlQion vere then combined randomly* For example^ the eight items 
mder the subdi vision ^^soeifiJ.-professlonal climate*^ In each of the i^leal* 
marginal end unacceptable situations ^ vere randomly grouped within one sub* 
division {hy the same title) ^ giving that subdivision a total of tventy^four 
items • This was done for all subgroups under each of the five information ar-^as. 

Such a procedure was followed for the developiaent of both the TSC-A and 
the TSC-'B. In cases where the information collected from the six change agents 
for the TSC*-3 was less extensive than for the ISG-^A, it was necessary to take 
some items directly from the TSC*A in order to equalise the itens on tht; TSC-l:i. 
The items which were selected in this manner did not contain references to mouulea 
and were related to situations which would be applicable to both module-adopting 
institutions and institutions adopting assessment batteries with a counseling 
orientation. Examples of two subscales^ one for the TSC-A and one for the 
TSC-B^ are attached at the end of the paper. 

Data Source 

The six change agents mentioned above were the data source upon which thu 
TSC was built. Although their anonymity has been guaranteed, their back^roundc 
can be briefly described » Change agent number one : has worked in two teacher 
training Institutions which had adopted innovations similar to those described 
by the TSC. ^One Institution was remote and rural and the second vac lh.riy^^ 
mid-western university. ) Change agent number two : was asked by the coll^j;-*- ^xa^ 
ministration of a small rural teacher training Institution to organize a new 
teacher training program, brought people with him and attracted generous govern- 
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ment fundiag. Change agent n^mfber threa t had several years of experlt^nce in 
a major state university which had field touted innovations .'Bir.ilur to \ho::c? 
described by TGC^ and wan ^)roiight In by the raciilty and adninintratlon of ?x 
siriall state teacher training institution to install a cor*pr-tency*b^isod t'^j^cht?:^ 
education pr ograan* Change agent number four : was a member of a resource agei:.c:/ 
team involved in the dissemination of educational innovations and has had ex- 
periences in a variety of higher education institutions. Chan/^e agent number 
five : worked as an interoal change agent along with change agent numher two at 
the same setting and has had more recent e3q)erience as an external chan^^e ager.t^ 
Change ai^ent ^ numher six : has had hoth national and international experiences 
as a change agent and has worked in training institutions ^ loe^il school districts^ 
and institutions of higher learning. 

Concluding Remarks 

Hopefully, The '^Trouble Shooting" Checklist represents the first stages 
of development of an instrument which can guide an in^^xperienced, as well as un 
experienced change agent through an organizational maze^ Without such an 
instrument I a change agent would need considerable experience to recognize 
institutions which had not developed to the point vhere innovations could be 
integrated into their programs. The TSC offers the potential of being a 
systematic short cut to many painful years of trial and error experience. On 
the other hand, an experienced change agent could use the Tf^C to quickly or^^iXiiz^ 
the cues to which he instinctively responas* 



ERLC 



Examples of Items from the TSG-A 
Organisation ?;tructuye Scale 

CHECK O^Vi THE ^ ITEMS TliAT MOST APPLY 

Category B: nQcial»-Professlonal Climate of the Orgtini^^jLtinn 

The institution meo'' coimittod to another innovation 
already developed or has no need for the change agent '•s 
innovation* 



2, 



There is a group leader in the organi^sation vho is cognisant 
of group dynamic techniq^ues and can work effectively with 
the group. 

3. The institution bz a vhole has respect for its education 
department, hut there is little interaction h^^tween tho 
education department and the rest of the uni veracity. 

Ji« The institution has ample resources upon which xo draw for 
the adoption of innovations. 

5. The institution is liberal arts oriented with a hi as against 
education V 

6. This instituxion emphasizes publication , independent investi- 
gation, and training of doctoral students, 

T. Althouigh the faculty have enough professional r^ecurity to 
risk failure, their personalities are such that they would 
not take great risks. 

6. Individual members within the organization are able to rc-in- 
force one another* 

:9o The institution as a whole has respect for its education io- 
partment and draws regularly on its resources. 

10, There is much emphasis placed on an overly literal interpreta- 
tion of "democracy," which may result in paralysis of the 
innovati on process . 

11. There is an organizational inertia at this ini^titution^ 
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12. There is much concern with the status quo little 
reward for innovation^ 

13 » Althou^^^h individual memb^rB of the department ar*r o.- 

Ijoocl toOTB| the;- ^irr? not in a position to reinforce ^ach 
other,. 

Ik. The institution definitely rewards innovation* 

15. There is much intorest in the techniques involved in the 
use of the innovTition^ hut limited concern vith its impact 
on the students* 

iC^ Although the institution is not isolated, it ntill is not 
yet fully integrated into the community* 

ITx, There is an emphasis on the development of students and a 
concern ahout the impact of an innovation on the education 
of students. 

18^ The institution is small and isolated. 

19. The institution is an integral part of the community. 

20. There is an atmosphere of professional security, and the 
adopters feel that they are able to risk failure. 

21. There are very contservative constituents a:nd consuir.f;rs t \ 
t hi B inst i tut i on , 

2S. The resources which can he used for the adoption of innovri- 
tions are limited^ 

23 o Although innovation is sometimes encouraged, no clear-cut 
rewards for innovating are apparent. 

rH.. The institution may he prestige oriented. 
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Examples of Items from the TSG-B 
0rg?inl2.atiQn Btructure Scale 

CHECK ONLY THE 5 ITEMS THAT MOST APPl^Y. 

Category C: Characteristics of the Counselors 

Iv The counselors are grouped with student iservicea organizations 
and are overly conscious of legal respon3rrjilitiies associated 
vith confidential files • 

2. The counselors are anti^measurement. 



3* Although the majority of the counselors are supportive of the 
program adoption^ there are a fev who still have serious reser- 
vations . 

1^. Counselors have fuculty appointments ajid are r^rspected as equal 
members of the department » 

5. . The counselors have both a humanistic orientation and a respect 

for the value of psychological measuremti.t, 

6. The counselors are encouraged by one or two curriculum £ind 
instruction faculty members*. 

7* Counselors are not on the faculty and have other concerns- 

8» The orientation of the counselors is not clear and is so 
diffused that any unified effort will be difficult* 

9# Some counselors have faciLLty appointments, but others do not» 
As a result , their concerns are not all focused in the s^iO 
direction* 

10, Counseling psycholo/jists have a behavioral orif^r.tv.r^.r. , ^.r.d 
their actions reflect this viewpoints 

II* The counselors are interested in the innovation^ hut have r^t 
yet taken action* 

IJ?* Counseling psychologists are supportive of the program, ^j^doptio: * 
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13* Some of the coiinseloyc have their dout)ts about thc^ value- 
of psychological ineasurement hut are villiiig to go alon^ 
with the other counselors who are more supportive of the 
program* 

ik^ The institution has counseling psychologists who ar^ ir; 
philosophical agreement with the counseling orientation c 
the psychological assessment hattery* 

15 • There are counselors with strong disagreements ahout the 
philosophical assxjmptions underlying the innovation* 
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